BoundsError: attempt to access 3-element Vector{String} at index [1]

on CI. Wat?

@KristofferC That exception almost certainly happens because some test uses try/catch to mutate some variable, then resets it before the error is printed.

Example:

julia> old_depot = copy(DEPOT_PATH)
       try
           empty!(DEPOT_PATH)
           DEPOT_PATH[1]
       finally
           copy!(DEPOT_PATH, old_depot)
       end
ERROR: BoundsError: attempt to access 3-element Vector{String} at index [1]

Yep, I think the test that fails is not really valid anymore with this change.

Triage wants to know how this impacts the runtime of julia-runtest and how many MB it saves (Sam mentioned it saves about 200MB out of a total of 1.1GB install size). It's hard to give an answer without real numbers here.

Another option is to have a different tarball for CI than regular users.